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Abstract 



DETECT is a nonparametric, conditional covariance based procedure to identify di- 
mensional structure and the degree of multidimensionality of test data. The ability composite 
or conditional score used to estimate conditional covariance plays a significant role in the 
performance of DETECT. The number correct score of all items in the test (T) and the 
number correct score of remaining items (S), other than the two items in consideration, are 
two natural candidates for computing conditional covariances. However these conditional 
scores produce biased estimates in finite samples. Some type of correction is required in 
computing the estimates of conditional covariances. This study investigated the effect of 
centering and/or averaging T and S as bias correction methods. This process resulted in six 
different estimates of conditional covariances for use in the DETECT procedure. 72 types of 
test data were simulated that vary in sample size, test length, degree of multidimensionality, 
and distribution of items into clusters. The impact of the six estimates on the performance 
of DETECT were studied on three aspects: Dmax value, r ratio, and the percentage of items 
correctly classified into clusters. The results showed that, the centered conditional score S 
performed the best. The next best index was the average of T and S with centering, followed 
by the average of T and S without centering. 
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DETECT (Zhang & Stout, 1999a, 1999b) is a nonparametric statistical procedure for 
the dimensionality assessment of binary data resulting from monotone models. It determines 
the simple latent dimensionality structure of a test composed of dichotomously scored items. 
A simple dimensionality structure of a test means that each item in the test can be classified 
into one and only one of the dimensionsional clusters. Given a set of items, the DETECT 
procedure partitions items into separate clusters so that items within the same cluster are 
substantively dimensional homogeneous and clusters are substantively dimensional distinct 
from each other. In addition to discovering the dimensional structure of a test, the DETECT 
procedure also reveals the seriousness of multidimensionality present in the test data. Zhang 
and Stout (1999b) showed that the DETECT procedure is very effective in this regard when 
in fact there exists a simple structure underlying a set of item response data. 

The mathematical logic behind the DETECT procedure is that, for examinees with 
similar abilities, items measuring the same latent abilities are likely to have positive co- 
variances. On the contrary, items measuring different latent abilities tend to have negative 
conditional covariances (Rosenbaum, 1988; Douglas, Kim, &; Stout, 1994). Therefore, condi- 
tional covariance forms the basic building block of the DETECT procedure. The conditional 
score used in computing the conditional covariances of item pairs plays a critical role on 
the performance of DETECT procedure, and it directly affects the precision of what the 
procedure yields. Currently two ways are available to compute the conditional covariances 
of the DETECT index: (1) Kim (1994) proposed computing the covariance conditional upon 
the total score of remaining items other than the two items in consideration, and centered, 
that is, (Coviji2(5) - Cov(5)); and (2) Zhang and Stout (1999b) have proposed taking the 
average of two conditional covariances: one based on the total score of the test Covjjjj (T) 
and the other based on the total score of the remaining items on the test, Covi^i^iS). There 
are clearly other ways of choosing the conditional score in computing conditional covariances. 
The choice of the conditional score could greatly impact the performance of the DETECT 
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index. To date, no extensive study has been done to investigate different ways of computing 
conditional covariances and how they benefit the DETECT procedure the most. 

The purpose of the present study is to investigate the effect of different conditional 
scores on the performance of the DETECT procedure through simulated multidimensional 
data. Three conditional scores will be considered along with the option of centering (centered 
and uncentered), resulting in six different ways of computing the DETECT index: ( 1 ) condi- 
tion on total number right score uncentered, ( 2 ) condition on the number right on remaining 
items of the test uncentered, (3) Average 1 and 2, (4) condition on total number right score 
centered, (5) condition on the number right on remaining items of the test centered, ( 6 ) 
average of 4 and 5. 



The Theoretical DETECT Index 



DETECT is an extremely powerful technique that is based on a strong theory of 
conditional covariances and utilizes a genetic algorithm to arrive at the partition of items 
that quantifies the maximum degree of multidimensionality present in the given test data. 
The theoretical computation of DETECT index is described briefly as follow (for details, see 
Zhang & Stout, 1999b). 



Let N denote the number of dichotomous items of a test. Let V = Ai,A 2 ,---,Afc 
denote a partition of the N test items into k clusters. The theoretical DETECT index, which 
gives the degree of multidimensionality of the partition V is defined as. 



” N{N- 1) „ ««(P)B|Cov(X,, Xj\&r = «)l, 

where, © 7 ^ is the test composite, Xj are scores on items i and and 

1 if items i and j are in the same cluster of V 
“1 otherwise 




( 1 ) 

( 2 ) 
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D{V, Ot) measures the amount of multidimensionality present for the given partition 
■p. Obviously, there are numerous ways to partition items of a test into clusters, and each 
partition produces a value of £)(P,©t)- The partition P* which produces the maximum 
value among all possible P(P, 0t)’s, is treated as the optimal simple dimensionality struc- 
ture of the test, and Dmax('P) associated with P*, is treated as the maximum amount of 
multidimensionality present in the test data. For example, for a purely unidimensional test, 
the optimal dimensionality structure of the test is that all the items will be partitioned into 
one single cluster, and the value of Dmax^P) of fho fost will be close to 0. It has been shown 
by Zhang and Stout (1999b) that when there is a true simple structure underlying test data, 
£)(P, 0t) will be maximized only for the correct partition. 

In order to determine if the partition P that maximized the DETECT index D(P, 0t) 
is indeed the correct structure of the test, the following ratio can be useful; 

^ Dmax{V, Qt) /g'j 

D*{V,Qt) 

where 

d -{ v ,& t )= E l^;icov(Xj,x,|eT = «)ll, (4) 

When there is a simple structure underlying test data, the ratio r is close to 1. The 
extent to which r differs from 1 is indicative of the degree to which the structure of the test 
deviates from the simple structure. 

Estmation of the DETECT Index 

To estimate E[Cov{Xi,Xj\QT = ^)], a statistic, in place of the latent variable (0t), 
is needed as the conditional score. As discussed by Zhang and Stout (1996, 1999), there are 
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two natural estimators of £'[Cov(Xj, XjIGt = ^)]: 

C^VijiT) = f; ^C^v{Xi, Xj\T = m), (5) 

where the conditional score T = J^iLi Xi is the total score of all test items; J is the total 
number of examinees; and is the number of examinees in subgroup m with the total 
score T = m. Cov{Xi, Xj\T = m) is the sample conditional covariance for examinees in the 
subgroup m. The other is the estimator based on the total score of remaining items given 

by, ^ ^ 

= E X^\S = m), (6) 

where the score S = Xi is the total score of the remaining items, other than items 

i and j. Jm is the number of examinees in subgroup m with the conditional score S = m, 
and Cov(A’j,Xj|5 = m) is the sample conditional covariance for examinees in the subgroup 
m. 



When a test is unidimensional, Covjj(T) tends to be negative because items X^ and 
Xj are part of T. Therefore, Covjj(T) as an estimator of ^[Cov(A’j, Xj IOt = ^)] results in 
a negative bias (Junker, 1993; Zhang and Stout, 1999a). CoVy (5), on the other hand, tends 
to be positive and results in a positive bias (Rosenbaum, 1984; Holland and Rosenbaum, 
1986; Zhang and Stout, 1999a). 

In the original DETECT index Kim (1994) proposed CoVy(S') as an estimator of 
E[Cov(A’j, Xj| 07 ’ = ^)], and further used a correction for the positive bias resulting in the 
following index: 

D,(V) = «.,(T’)|C?v.,(S) - C^l (7) 

where is defined in Equation (2) and Cov(5) is the average of CoVy(5) over all A^(A^-l)/2 
item pairs. The average Cov(5) is subtracted from each CoVy(5) to correct for the positive 
bias in the unidimensional case. 
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Since Cow ij{T) tends to have a negative bias and Covjj(S) tends to have a positive 
bias as estimators of E[Cov(Xi, Xjl0T = ^)] in the unidimensional case, Zhang and Stout 
(1999b) proposed an average of these two estimates resulting in the following index for 
DETECT: 

where 

C^v;. = ^[^Vi,(5) + C^Vi,(r)]. (9) 



Zhang and Stout ( 1999b) ’s rationale for suggesting Equation (9) is purely theoretical 
in nature. Zhang and Stout (1999b) recommend Dzsi'P) based on their results of a small 
scale simulation study. 



Clearly there are other possibilities for estimating £?[Cov(Xj, Xjl0T = ^)]- For ex- 
ample, the total score T with (or without) the correction for the negative bias, or further 
correction for the average covariance, Cov^ could improve the performance of DETECT . Six 
different estimates of E[Cow{Xi, XjlQr = &)] are considered in this study for comparison 
purposes. The three main estimates are: 1) Covij(5), 2) Covij(T), 3) Cov^. As a correction 
for the bias all three estimates are also centered resulting in six indices as follows. 



D,{V) = 


2 


N{N-1) 


D,(V) = 


2 


N{N - 1) 


Dz(V) = 


2 


N{N - 1) 


D,(V) = 


2 


N{N- 1) 


D,{V) = 


2 


N{N - 1) 



^ 6,j{V)[Cow,j{T)] 

l<i<j<N 

i„(P)l»Vy(S)| 

l<i<j<N 

2 : 5,j{V)cSvl 

l<i<j<N 

^ 5i^{V)[C^Vij{T) - c5v{T)] 

l<i<j<N 

5ij {V)[Cov ij {S) - Cow (S)] 

l<i<j<N 



( 10 ) 

( 11 ) 

( 12 ) 

(13) 

(14) 
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Dt{P) 



(15) 



where 5ij, Cov(5), Cov(T), Cov^-, and Cov(5) are as defined before. Cov(T) is the average of 
CoVy(T) over all A^(A^ — 1)/2 item pairs; and Cov is the average of CoVj^ over all A^(AT— 1)/2 
item pairs. The index is same as Dk, and the index D 3 is the same as Dzs- All the 
six indices are studied and compared in simulated settings of one and two-dimensional tests 
for their ability to correctly classify items into different clusters and to assess the degree of 
multidimensionality present. 

In order to obtain the optimal simple dimensional structure of a test, a Genetic 
Algorithm (GA) is built in the DETECT procedure to correctly classify items into different 
dimensional clusters (Zhang & Stout, 1996b). GA is an optimization tool to iteratively 
change items’ cluster memberships until D{V*) is reached. 

Simulation of Two-dimensional Composite Test Data 

A two-dimensional composite test measures two latent abilities. Each item in the 
test is driven by two latent abilities (^ 1 ,^ 2 ) simultaneously. Each item measures a weighted 
linear combination of 9i and 62 , which is called a composite. The direction of an item 
composite is determined by its angle value in the (^ 1 ,^ 2 ) plane, which is another type of 
item representation used in NOHARM (a non-linear factor analysis program in McDonald’s 
non-linear factor analysis procedure). The angle of an item composite is defined as the ratio 
of its discrimination parameter on 62 ( 02 ) to its discrimination parameter on 61 (oi). Figure 
1 illustrates the basic idea of the angle value type item representation. Line li represents 
a composite of item i. When a. is less than 45°, the composite relies more heavily on 9i 
than on ^ 2 ; when a is larger than 45°, the composite relies more heavily on ^2 than on 9\. 
In other words, as ot increases, latent ability ^2 contributes more to the composite. A test 
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is said to be essentially unidimensional if all item composites in a test lie almost in the 
same direction (within a narrow fan). Items within distinct narrow fans (clusters) measure 
different composite abilities. 

Test data with a two-cluster structure (two distinct composite abilities) were simu- 
lated in the current study. Figures 2 shows an example of a test with two item clusters. 
Items within each cluster are believed to measure the same latent ability composite, and 
the clusters represent distinct latent ability composites. The smaller the angles between the 
clusters in a test, the less the degree of multidimensionality the test appears. Higher the 
percentage of items within a cluster, less the degree of multidimensionality. 

The simulated angle values of the clusters used in the present study are illustrated 
in Table 1. As can be seen in the fist two columns of Table 1, there are six combination of 
angles where the angular difference between item clusters ranges from 0 to 90 , denoting 
the increase in the degree of multidimensionality. For each angle combination, three types of 
distribution of test items are considered; all test items are in Cluster 1; two-thirds of items 
in Clusterl and one-third in Cluster2; and half of items Cluster! and half in Cluster2. For 
example, for 30-item test: all 30 items are in Clusterl and 0 in Cluster2; 20 items in Clusterl 
and 10 in Cluster2; 15 items in Clusterl and 15 in Cluster2. Unidimensionality results when 
all test items are included in one cluster; and also when the angle-difference between the 
clusters is 0°. The shaded rows of Table 1 indicate unidimensional tests. 

In order to make the simulated data as realistic as possible, estimated item parameters 
from the National Assessment of Educational Progress test data (The 1992 NAEP Technical 
Report) were used in this study. Table 2 gives a summary of descriptive statistics of item 
parameters. For a two-dimensional composite item i with angle value its item parameters 
were defined in the following manner (Kim, 1994): 
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A set of unidimensional item parameter estimates a^, and Cj was randomly selected 
from the 1992 NAEP item pool (collection of item parameter estimates from the report). Us- 
ing these estimated unidimensional parameters, two-dimensional parameters were computed. 
The two-dimensional discrimination parameters were defined as 

an = ai cos(ai) a2i = ai sin(o:i). 

Difficulty and guessing parameters for a dichotomous item were defined as 

The amount of the multidimensionality in a two-dimensional composite test was de- 
termined by the angle between the clusters, the correlation between abilities (which was 
fixed to 0.3 in the current study), and the distribution of test items in the two clusters. 

Each examinee’s abilities 9i and 62 are randomly generated from a bivariate nor- 
mal distribution with the correlation coefficient between the abilities fixed at 0.3. Two test 
lengths: 30 and 60 were considered in the present study. In all there are 36 different com- 
bination of tests (2 test lengths x 6 angle-combinations x 3 item distributions to clustrs) 
denoting different degrees of multidimensionality in items. Each of these 36 combinations is 
crossed with two sample sizes (500 and 1000) producing 72 types of test data. In each case 
dichotomous item responses were generated according to the three-parameter logistic model 
with two compensatory abilities (Reckase & McKinley, 1983) given by 

PiiOij, 02 j) = Ci + 1 + exp[-l.l[au{exj - bu) + a 2 i{ 02 ^ - &2i)] ’ 
where Pi{ 0 ij, 02 j) is the probability of correct response to the dichotomous item i by an 
examinee j with ability ( 9 ij, 92 j). an is the discrimination parameter of the dichotomous 
item i on 0i and a 2 i is the discrimination parameter of the item i on ^2- Similarly, bn is the 
difficulty parameter of item i on and 621 is the difficulty parameter of item i on 62 . Cj is 
the guessing parameter of the item i. 
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For each simulated examinee, response probability for each item was computed using 
the above equation. If the computed probability was greater than the uniform random 
variable generated from the interval (0,1), then the item was considered answered correctly 
and a score of 1 was assigned. Otherwise a score of 0 was assigned. 

For each test data (72 in all), the DETECT procedure was implemented six times 
and the following information was recorded for each of the six indices, D\ through Dq\ 

• The percentage of items correctly classified into intended clusters. 

• Dmax - the maximum value of D{V) associated with the best simple structure solution 
available for given data. 

• r = “ the degree of divergence from simple structure. The degree to which r is 

further from 1 indicates the degree of divergence, of the dirnensional structure of given 
data, from the simple structure solution. 

This procedure was replicated 100 times and results were averaged and tabulated. 

Results 

Tables 3 and 4 show results for the percentage of items correctly classified into in- 
tended clusters. Table 3 shows results for 30 items and Table 4 for 60 items. Cell values are 
the mean percentages, over 100 replications, of items correctly classified into clusters along 
with the standard deviations. In each table there are six panels, one panel for each angular 
difference. Each panel contains percentages of items correctly classified in the three different 
item distributions for both sample sizes (across columns) for all six indices (across rows). 
These results are plotted in Figures 3 and 4. Figures 3 shows graphs for 30 items and Figure 
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4 for 60 items. Each of Figures 3 and 4 have four graphs (two clusters crossed with two 
sample sizes). ^ Some general expected trends can be observed from these figures. It can be 
seen from Figures 3 and 4 (3a through 3d; 4a through 4d) that, as the angular difference 
between the clusters decrease from 90° to 10°, the percentage of items correctly classified into 
clusters decreases from near 100% to about 50%. As the number of examinees increases, the 
percentage correct increases, especially for the angular differences smaller than 50°. This is 
true for both test lengths. There is a slight increase in the percentage correct when items are 
equally distributed into clusters (15/15 and 30/30 items) than unequal distribution (20/10 
and 40/20). 

Regarding the comparison of six methods with respect to the percentage of items 
correctly classified, the overall performance of Di and D 2 is not consistent. For example, 
D 2 is high only when the angular difference between the clusters is large such as 90° and 
70°, coupled with a higher percentage of items within a cluster. In other cases D 2 performed 
badly. Whereas the performance of through show a consistent pattern across condi- 
tions. Average percentages of items correctly classified collapsed over sample sizes and item 
distributions are plotted in Figures 9a and 9b. Performance of Di and D 2 is not further 
considered as they are unreliable. Careful examination of the performance of the rest of 
the four indices through Zlg (for all item distributions, different angular differences, and 
sample sizes) reveals that, overall, Z? 4 (conditioning on N items with centering) is slightly 
better than T>6 average with centering), which is slightly better than (conditioning on 
N — 2 items with centering). 

Results for Dmax are listed in Tables 5 and 6 for 30 and 60 items respectively. These 
Tables are organized similar to Tables 3 and 4. In that there are six panels, one for each 
angular difference. The cell values of the table give mean Dmax values along with their 

^The percent correct for unidimensional cases are not graphed as there is only one cluster. 
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standard deviations over 100 replications. The Dmax values are plotted in Figures 5 and 6 
for 30 and 60 items respectively. Each figure contains six graphs (3 item distributions by 2 
sample sizes). 

Unidimensionality results when all test items are in one cluster (graphs 5a, 5b, 6a, and 
6b), irrespective of the angular differences between clusters. In all unidimensional graphs, as 
expected, the plots are straight lines. That is, for unidimensional tests, the direction of the 
best measurement has no effect on Dmax value, as it should be. It can also be seen that Dmax 
values decreases as the test size and sample size increase. Since the test size and sample 
size influence conditional covariances, they in turn affect the values of Dmax- Average Dmax 
values collapsed over sample sizes and item distributions are plotted in Figures 10a and 10b. 
From these figures it is evident that, these averages are all small (less than .20), and D^ and 
T >4 are lowest, followed by D^ and Dq, although these differences are small. 

The rest of the graphs in Figures 5 and 6 are for two-dimensional data. In two- 
dimensional test data, the emphasis is on power. That is, one expects higher Dmax values 
associated with test data reflecting higher degree of multidimensionality; and for these indices 
to be sensitive to the degree of multidimensionality present in test data. It can be seen from 
these figures that as the degree of multidimensionality decreases from near simple structure 
sceneriio to a single unidimensional cluster, the Dmax values range from high .90 to below .20. 
Dmax values are higher when items are equally distributed into clusters (30/30 or 15/15) than 
for unequal distributions (40/20 or 20/10). They are also higher for 30 item test data than 
60 item test data. Average Dmax values collapsed over sample sizes and item distributions 
are plotted in Figures 10c and lOd. Comparison of T >2 through De shows that the general 
pattern appears to be favoring T>s, which has highest Dmax values, followed by D^ and T> 3 , 
and then D 4 , although the differences are small. 

Results of r values are listed in Tables 7 and 8 for 30 and 60 items respectively. 
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These tables are organized similar to Tables 3 to 6. The cell values give mean r values and 
their standard deviations over 100 replications. These results are plotted in Figures 7and 
8 for 30 and 60 items respectively. Each of these figures have four panels corresponding to 
multidimensional test data. One expects to find r values near 1 for simple structure test 
data (with angular difference of 90° between the clusters and equal distribution of items into 
clusters) . It can be seen that r values for simple structure test data are the highest (about 
.90) and gradually decrease as the angular difference decreases from 90° to 10°. Moreover, 
the r values increase as the sample size increases; higher for equally distributed clusters 
(15/15 and 30/30). r values are higher for 30 item test data than 60 item test data. Average 
r values collapsed over sample sizes and item distributions are plotted in Figures 11a and 
11b. Comparing D 3 through Dq it can be seen that all indices seem to be functioning equally 
well for 90° and 70°. At 50° or below D 5 seem to be performing slightly better than others, 
Z ?3 and Z?6 are about the same followed by D4. 

Summciry and Discussion 

The conditional score used in estimating the conditional covariance could play a 
significant role on the performance of DETECT as a procedure to identify the simple di- 
mensional structure underlying test data and to quantify the degree of multidimensionality 
present in data. This study is a pilot to investigate the performance of DETECT procedure 
with respect to different conditional scores. There are two natural ways for estimating the 
conditional covariance: conditioned on the total test score (T), conditioned on the score of 
remaining items (S). As discussed earlier, both of these estimated covariances are biased 
estimates, in opposite directions, of the true conditional covariance. Kim (1994) suggested 
the use of centered S, where centering served as a correction for the positive bias in S. 
Zhang and Stout (1999b) suggested taking the average of the conditional covariances, S and 
T so that the bias gets canceled out. Naturally, there are other ways of obtaining estimated 
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conditional covariances. In this study two types of bias correction were considered: averaging 
the conditional covariances T and 5 , and centering the indices (centered versus uncentered), 
resulting in six different estimates of conditional covariances. 

The Performance of the DETECT procedure was compared using all six indices Di 
through D(3 with respect to: (a) the percentage of items correctly classified, (b) D^ax values, 
and (c) r values, for varied test length, item distributions, and sample sizes. Since Di and D2 
showed unreliable and inconsistent results with respect to the percentage of items correctly 
classified into clusters, these were eliminated for further consideration. Comparison of D3, 
D4, T>5, and T>6 showed that in ideal situations, such as clear simple structure solution with 
an angular difference of 90 ° to 70 °, all four indices performed similarly. However, in other 
cases, D4 was best with respect to the percentage of items correctly classified into clusters, 
followed by Dq and by D5. Whereas D5 was better than other indices with respect to Dmax 
and r values. Based on this study it can be concluded that, taken as a whole, (conditioned 
on S and centering) performed best. The next best index was Dq (average of T and S with 
centering), followed by D3 (average of T and S without centering), although the difference 
between De and D3 is trivially small. 

This study is limited. Although we have investigated six different correction proce- 
dures for the bias in estimating the conditional covariance, there are more ways to correct 
for this bias. For example, based on theory, conditional covariance based on T is negatively 
biased. Hence it makes sense to center it by adding the mean conditional covariance in- 
stead of subtracting, as done in this study. Whereas for the average conditional covariance, 
Cov*j, the theoretical argument suggests the bias can cancel out by averaging. However, it 
is not known, if the magnitude of bias is same in both directions. Perhaps one could shift 
the estimated covariance positively and negatively to see what works best. Although is 
the recommended procedure based on this limited study, a more detailed follow-up study is 
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needed to confirm this conclusion. 



Educational tests are increasingly becoming intentionally multidimensional. Modeling 
such data by the test composite, a composite of latent traits, is a convenient and useful 
approach for determining the dimensional structure of the test. In this regard, DETECT 
is an extremely effective procedure to detect the multidimensional structure of data, and to 
classify items into dimensional clusters. Given the importance of the DETECT procedure 
for the assessment of educational test data, more studies on the usefulness of the procedure 
is important. 
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Table 1: Angles and Items in Each Cluster (« is the angle between items in Clusterl 
and ^1 -direction, P is the angle between items in Cluster2 and -direction) 



Angles 


Angle between 
Clusters 


30 items 


60 items 






Clusterl 


Cluster 2 


Cluster 1 


Cluster 2 


0^90", p=0” 


90 


30 


0 


60 


0 






20 


10 


40 


20 






15 


15 


30 


30 


0^80°, p=10° 


7D 


30 


0 


60 


0 






20 


10 


40 


20 






15 


15 


30 


30 


0=70°, p=20° 


5D 


30 


0 


60 


0 






20 


10 


40 


20 






15 


15 


30 


30 


ot=60°, p=30° 


3D 


30 


0 


60 


0 






20 


10 


40 


20 






15 


15 


30 


30 


ot=50°, p=40° 


H5 


30 


0 


60 


0 






20 


10 


40 


20 






15 


15 


30 


30 


0^5°, P=45° 


D 


30 


0 


60 


0 






20 


10 


40 


20 






T5 


15 


30 


30 



* Shaded cells represent unidimensional tests. 



Table 2: Descriptive Statistics of Item Parameters 





a 


b 


c 


Mean 


1.007 


0.282 


0.202 


Std. 


0.503 


1.345 


0.100 


Max. 


2.615 


5.093 


0.465 


Min. 


0.281 


-5.565 


0.000 
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Table 3: Percentage of Items Correctly Classified into Clusters for 30 Items 
(Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 






30-0 

N=500 N=1000 


20-10 

1 N=500 N=1000 


15-15 

N=500 N=1000 


Angle between Clusters = 


90 (a=90“ 3=0") 






All N items W/0 Centering 


100 

0 


100 

0 


74.57 

4.51 


75.60 

3.87 


84.20 

4.61 


86.23 

3.63 


N-2 items W/0 Centering 


100 

0 


100 

0 


98.47 

2.39 


99.10 

1.63 


98.23 

2.34 


99.43 

1.34 


Average W/0 Centering 


100 

0 


100 

0 


91.40 

4.67 


92.87 

3.11 


94.57 

3.93 


96.57 

2.90 


All N items W Centering 


100 

0 


100 

0 


94.30 

4.19 


96.47 

2.80 


96.60 

3.32 


98.17 

2.39 


N-2 items W Centering 


100 

0 


100 

0 


92.40 

3.70 


93.93 

2.86 


94.10 

3.38 


95.50 

2.70 


Average W Centering 


100 

0 


100 

0 


93.40 

4.32 


95.27 

3.08 


96.00 

3.61 


97.53 

2.58 


Angle between Clusters = 


70 (o=80" 


3=10") 






All N items W/0 Centering 


100 

0 


100 

0 


70.13 

4.97 


72.53 

3.76 


75.63 

4.44 


78.20 

3.46 


N-2 items W/0 Centering 


100 

0 


100 

0 


86.60 

14.30 


83.57 

15.79 


85.13 

19.46 


86.83 

20.24 


Average W/0 Centering 


100 

0 


100 

0 


82.67 

6.60 


86.00 

3.82 


87.10 

5.72 


89.63 

4.44 


All N items W Centering 


100 

0 


100 

0 


85.23 

6.95 


89.03 

4.62 


88.43 

6.15 


91.37 

5.08 


N-2 items W Centering 


100 

0 


100 

0 


83.40 

6.62 


87.87 

3.43 


87.03 

4.44 


89.47 

3.69 


Average W Centering 


100 
0 . 


100 

0 


84.70 

5.99 


88.13 

4.00 


88.50 

5.39 


91.33 

4.74 


Angle between Clusters = 


50 (O=70" 


3=20") 






All N items W/0 Centering 


100 

0 


100 

0 


59.63 

6.93 


65.77 

5.68 


65.67 

6.10 


70.30 

4.24 


N-2 items W/0 Centering 


100 

0 


100 

0 


65.50 

2.61 


65.93 

1.54 


51.37 

2.33 


50.77 

1.41 


Average W/0 Centering 


100 

0 


100 

0 


66.63 

11.45 


77.00 

9.27 


74.03 

9.75 


79.37 

6.75 


All N items W Centering 


100 

0 


100 

0 


69.90 

11.26 


79.10 

7.37 


74.23 

9.16 


79.57 

7.53 


N-2 items W Centering 


100 

0 


100 

0 


61.53 

13.83 


72.27 

13.56 


72.43 

11.58 


75.77 

12.69 


Average W Centering 


100 

0 


100 

0 


68.33 

11.42 


78.23 

8.91 


75.53 

8.99 


81.10 

7.79 



(To be continued) 
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Table 3 (Continued): Percentage of Items Correctly Classified into Clusters for 30 
Items (Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








30-0 


20-10 


15-15 




N=500 N=1000 


N=500 


N=1000 


N=500 


N=W00 


Angle between Clusters = 


30 (0^90°, 3=0°) 






All N items W/0 Centering 


100 


100 


46.30 


50.47 


48.43 


51.90 




0 


0 


6.46 


7.89 


6.69 


8.21 


N-2 items W/0 Centering 


100 


100 


65.27 


65.73 


51.63 


51.00 




0 


0 


2.93 


1.78 


2.86 


1.80 


Average W/0 Centering 


100 


100 


48.20 


52.77 


50.53 


51.67 




0 


0 


7.79 


8.94 


5.78 


7.15 


All N items W Centering 


100 


100 


50.97 


57.23 


51.57 


54.50 




0 


0 


7.75 


9.13 


6.52 


8.75 


N-2 items W Centering 


100 


100 


49.53 


51.57 


50.60 


49.93 




0 


0 


7.42 


7.03 


5.87 


5.19 


Average W Centering 


100 


100 


48.57 


53.13 


50.63 


51.90 




0 


0 


6.95 


8.71 


6.15 


6.80 


Angle between Clusters = 


10(0^50°, 


3=40°) 






All N items W/0 Centering 


100 


100 


42.73 


42.90 


43.10 


43.27 




0 


0 


4.86 


5.10 


5.32 


4.44 


N-2 items W/0 Centering 


100 


100 


64.80 


65.40 


51.40 


50.93 




0 


0 


2.97 


2.21 


1.91 


1.58 


Average W/0 Centering 


100 


100 


47.47 


49.10 


47.57 


47.80 




0 


0 


6.85 


5.56 


5.74 


4.42 


All N items W Centering 


100 


100 


49.57 


50.97 


47.20 


48.40 




0 


0 


6.28 


6.95 


5.29 


4.70 


N-2 items W Centering 


100 


100 


49.30 


49.83 


48.83 


48.47 




0 


0 


6.25 


5.79 


4.60 


3.80 


Average W Centering 


100 


100 


48.57 


49.97 


48.77 


48.77 




0 


0 


6.62 


5.71 


5.76 


3.87 


Angle between Clusters = 


0 (0=45°, 3=45°) 






All N items W/0 Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


N-2 items W/0 Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


Average W/0 Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


All N items W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


N-2 items W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


Average W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 
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Table 4: Percentage of Items Correctly Classified into Clusters for 60 Items 
(Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 






60-0 

N=500 N=J000 


40-20 

N=500 N=1000 


30-30 

N=500 N=J000 


Angle between Clusters = 


90 (0^90°, P=0°) 






All N items W/0 Centering 


100 

0 


100 

0 


75.00 

4.14 


78.22 

3.25 


90.42 

3.15 


92.43 

2.62 


N-2 items W/0 Centering 


100 

0 


100 

0 


97.93 

1.88 


99.13 

1.10 


98.55 

1.33 


99.55 

0.82 


Average W/0 Centering 


100 

0 


100 

0 


91.12 

4.63 


93.40 

2.73 


96.70 

2.18 


98.25 

1.56 


All N items W Centering 


100 

0 


100 

0 


90.58 

5.41 


93.50 

3.08 


97.72 

1.92 


98.87 

1.36 


N-2 items W Centering 


100 

0 


100 

0 


91.90 

3.00 


94.13 

1.92 


95.85 

2.27 


97.37 

1.66 


Average W Centering 


100 

0 


100 

0 


92.45 

3.98 


94.57 

2.51 


97.00 

2.22 


98.43 

1.46 


Angle between Clusters = 


70 (ot^80° p=10°) 






All N items W/0 Centering 


100 

0 


100 

0 


68.57 

3.82 


73.12 

3.34 


80.08 

3.59 


83.60 

2.85 


N-2 items W/0 Centering 


100 

0 


100 

0 


93.63 

5.81 


97.68 

1.83 


95.48 

2.72 


97.88 

1.62 


Average W/0 Centering 


100 

0 


100 

0 


82.27 

5.23 


87.20 

3.59 


89.80 

4.27 


93.10 

3.29 


All N items W Centering 


100 

0 


100 

0 


81.08 

7.03 


86.97 

3.98 


91.42 

4.58 


95.00 

2.92 


N-2 items W Centering 


100 

0 


100 

0 


84.67 

4.58 


88.30 

2.64 


89.05 

3.34 


91.77 

2.83 


Average W Centering 


100 

0 


100 

0 


83.82 

5.05 


88.48 

3.72 


90.70 

4.18 


93.92 

3.09 


Angle between Clusters = 


50 (ot^70°, P=20°) 






All N items W/0 Centering 


100 

0 


100 

0 


56.68 

7.03 


64.78 

4.50 


65.88 

5.63 


72.90 

4.25 


N-2 items W/0 Centering 


100 

0 


100 

0 


69.73 

7.99 


66.60 

3.35 


63.10 

17.88 


56.77 

15.60 


Average W/0 Centering 


100 

0 


100 

0 


67.15 

8.58 


76.55 

5.53 


74.00 

6.99 


83.53 

4.40 


All N items W Centering 


100 

0 


100 

0 


63.95 

9.66 


76.12 

6.90 


74.28 

8.29 


84.20 

5.06 


N-2 items W Centering 


100 

0 


100 

0 


69.65 

8.68 


78.33 

6.88 


76.15 

7.06 


82.37 

6.17 


Average W Centering 


100 

0 


100 

0 


67.73 

8.66 


78.43 

5.17 


74.37 

7.17 


84.03 

4.53 



(To be continued) 
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Table 4 (Continued): Percentage of Items Correctly Classified into Clusters for 60 
Items (Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








60-0 


40-20 


30-30 




N=500 N=1000 N=500 


N=I000 


N=500 


N=]000 


Angle between Clusters = 


: 30 (0=90°, 3=0°) 






All N items W/O Centering 


100 


100 


43.72 


48.27 


45.90 


51.48 




0 


0 


4.93 


5.74 


6.13 


7.62 


N-2 items W/O Centering 


100 


100 


65.13 


66.20 


51.85 


51.00 




0 


0 


3.05 


1.54 


2.28 


1.34 


Average W/O Centering 


100 


100 


49.13 


55.20 


48.30 


54.02 




0 


0 


7.70 


7.31 


5.99 


8.62 


All N items W Centering 


100 


100 


48.38 


54.68 


48.77 


54.47 




0 


0 


7.52 


7.44 


6.81 


7.92 


N-2 items W Centering 


100 


100 


53.20 


58.48 


49.43 


50.95 




0 


0 


7.50 


5.27 


6.28 


6.93 


Average W Centering 


100 


100 


49.08 


56.03 


48.60 


53.95 




0 


0 


7.48 


7.07 


6.79 


9.49 


Angle between Clusters = 


10 (0=50°, 3=40°) 






All N items W/O Centering 


100 


100 


41.22 


41.72 


41.25 


41.25 




0 


0 


4.19 


4.09 


3.60 


3.44 


N-2 items W/O Centering 


100 


100 


64.95 


65.97 


51.62 


50.90 




0 


0 


3.02 


1.73 


2.37 


1.17 


Average W/O Centering 


100 


100 


45.45 


50.43 


44.17 


45.15 




0 


0 


5.64 


6.08 


4.36 


4.24 


All N items W Centering 


100 


100 


45.08 


50.62 


44.90 


45.77 




0 


0 


5.95 


6.23 


3.41 


3.76 


N-2 items W Centering 


100 


100 


50.17 


54.00 


45.80 


47.30 




0 


0 


6.61 


4.67 


4.81 


3.73 


Average W Centering 


100 


100 


45.98 


51.70 


43.97 


45.47 




0 


0 


6.17 


5.61 


4.07 


4.07 


Angle between Clusters = 


0 (0=45°, 3=45°) 






All N items W/O Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


N-2 items W/O Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


Average W/O Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


All N items W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


N-2 items W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 


Average W Centering 


100 


100 


100 


100 


100 


100 




0 


0 


0 


0 


0 


0 
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Table 5: D-max Value for 30 Items (Standard Deviations Are Presented in Smaller 
Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








30-0 


20-10 


15- 


15 




N=500 N=W00 


N=500 


N=1000 


N=500 


N=I000 


Angle between Clusters = 


90 (0^90", 


II 

GO. 






All N items W/0 Centering 


0.44 


0.38 


0.87 


0.82 


0.97 


0.97 


0.03 


0.02 


0.10 


0.09 


0.11 


0.11 


N-2 items W/0 Centering 


0.48 


0.48 


0.82 


0.78 


0.90 


0.91 


0.04 


0.03 


0.12 


0.11 


0.14 


0.12 


Average W/0 Centering 


0.27 


0.22 


0.78 


0.73 


0.90 


0.91 


0.03 


0.02 


0.11 


0.10 


0.13 


0.12 


All N items W Centering 


0.25 


0.20 


0.75 


0.70 


0.86 


0.87 


0.03 


0.02 


0.12 


0.10 


0.13 


0.12 


N-2 items W Centering 


0.30 


0.26 


0.82 


0.77 


0.93 


0.94 


0.04 


0.02 


0.12 


0.10 


0.14 


0.12 


Average W Centering 


0.26 


0.21 


0.78 


0.73 


0.89 


0.90 


0.03 


0.02 


0.12 


0.10 


0.14 


0.12 


Angle between Clusters = 


70 (oc=80” 


3=10°) 






All N items W/0 Centering 


0.43 


0.37 


0.63 


0.60 


0.68 


0.66 


0.03 


0.02 


0.07 


0.05 


0.06 


0.06 


N-2 items W/0 Centering 


0.46 


0.47 


0.52 


0.50 


0.54 


0.53 


0.04 


0.02 


0.07 


0.04 


0.07 


0.07 


Average W/0 Centering 


0.28 


0.22 


0.50 


0.47 


0.56 


0.54 


0.03 


0.02 


0.08 


0.06 


0.08 


0.07 


All N items W Centering 


0.25 


0.20 


0.47 


0.44 


0.53 


0.51 


0.02 


0.02 


0.08 


0.06 


0.07 


0.07 


N-2 items W Centering 


0.32 


0.27 


0.52 


0.50 


0.59 


0.57 


0.03 


0.03 


0.09 


0.06 


0.08 


0.07 


Average W Centering 


0.27 


0.22 


0.49 


0.46 


0.55 


0.53 


0.03 


0.02 


0.08 


0.06 


0.08 


0.07 


Angle between Clusters = 


50 (0=70°, p=20°) 






All N items W/0 Centering 


0.42 


0.37 


0.48 


0.45 


0.50 


0.46 


0.02 


0.02 


0.04 


0.04 


0.03 


0.03 


N-2 items W/0 Centering 


0.46 


0.47 


0.46 


0.46 


0.45 


0.46 


0.03 


0.02 


0.03 


0.02 


0.03 


0.02 


Average W/0 Centering 


0.27 


0.23 


0.32 


0.30 


0.34 


0.32 


0.03 


0.03 


0.04 


0.04 


0.04 


0.04 


All N items W Centering 


0.25 


0.20 


0.30 


0.29 


0.32 


0.29 


0.02 


0.02 


0.04 


0.04 


0.04 


0.03 


N-2 items W Centering 


0.32 


0.29 


0.34 


0.32 


0.36 


0.34 


0.03 


0.03 


0.04 


0.04 


0.04 


0.04 


Average W Centering 


0.26 


0.23 


0.31 


0.29 


0.33 


0.31 


0.03 


0.03 


0.04 


0.04 


0.04 


0.04 



(To be continued) 
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Table 5 (Continued): D-max Value for 30 Items (Standard Deviations Are Presented 
in Smaller Font) 



Type of Conditional Score Number of Items in Each Cluster 

30-0 20-10 15-15 





N=500 


N=1000 


N=500 


N=1000 


N=500 


N=1000 


Angle between Clusters = 


30 (0(^90“ 


,3=0") 






All N items W/0 Centering 


0.42 

0.03 


0.36 

0.03 


0.42 

0.03 


0.36 

0.03 


0.43 

0.02 


0.37 

0.02 


N-2 items W/0 Centering 


0.45 

0.04 


0.46 

0.02 


0.46 

0.04 


0.46 

0.02 


0.45 

0.03 


0.46 

0.02 


Average W/0 Centering 


0.27 

0.04 


0.23 

0.03 


0.27 

0.03 


0.22 

0.03 


0.28 

0.03 


0.23 

0.03 


All N items W Centering 


0.25 

0.03 


0.21 

0.02 


0.25 

0.02 


0.20 

0.02 


0.25 

0.02 


0.21 

0.02 


N-2 items W Centering 


0.32 

0.04 


0.29 

0.03 


0.31 

0.04 


0.29 

0.03 


0.32 

0.04 


0.29 

0.03 


Average W Centering 


0.27 

0.04 


0.22 

0.03 


0.26 

0.03 


0.22 

0.03 


0.27 

0.03 


0.23 

0.03 


Angle between Clusters = 


10 (0(^50" 


3=40") 






All N items W/0 Centering 


0.41 

0.03 


0.36 

0.03 


0.42 

0.03 


0.36 

0.02 


0.42 

0.03 


0.36 

0.03 


N-2 items W/0 Centering 


0.45 

0.03 


0.46 

0.03 


0.45 

0.03 


0.46 

0.02 


0.46 

0.03 


0.45 

0.02 


Average W/0 Centering 


0.27 

0.03 


0.23 

0.03 


0.27 

0.03 


0.24 

0.03 


0.27 

0.04 


0.23 

0.03 


All N items W Centering 


0.25 

0.03 


0.21 

0.02 


0.25 

0.03 


0.21 

0.02 


0.25 

0.03 


0.21 

0.02 


N-2 items W Centering 


0.32 

0.04 


0.29 

0.03 


0.32 

0.04 


0.30 

0.03 


0.32 

0.04 


0.29 

0.03 


Average W Centering 


0.26 

0.03 


0.23 

0.03 


0.27 

0.03 


0.23 

0.03 


0.27 

0.03 


0.23 

0.03 


Angle between Clusters = 


0 (o=45“, 3=45") 






All N items W/0 Centering 


0.41 

0.03 


0.36 

0.03 


0.42 

0.03 


0.36 

0.03 


0.41 

0.03 


0.36 

0.02 


N-2 items W/0 Centering 


0.45 

0.03 


0.46 

0.02 


0.46 

0.03 


0.46 

0.02 


0.45 

0.04 


0.46 

0.02 


Average W/0 Centering 


0.27 

0.03 


0.24 

0.03 


0.27 

0.03 


0.23 

0.03 


0.27 

0.03 


0.23 

0.03 


All N items W Centering 


0.25 

0.03 


0.21 

0.02 


0.25 

0.03 


0.21 

0.02 


0.24 

0.02 


0.21 

0.02 


N-2 items W Centering 


0.32 

0.04 


0.30 

0.04 


0.32 

0.04 


0.29 

0.03 


0.32 

0.04 


0.29 

0.03 


Average W Centering 


0.27 

0.03 


0.23 

0.03 


0.27 

0.03 


0.23 

0.03 


0.26 

0.03 


0.23 

0.03 
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Table 6: D-max Value for 60 Items (Standard Deviations Are Presented in Smaller 
Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








60-0 




40-20 


30 


-30 




N=500 N=1000 


N=500 N=1000 


N=500 


N=J000 


Angle 


between Clusters = 


90 (ot=90°, p=0”) 






All N items W/O Centering 


0.27 


0.22 


0.49 


0.49 


0.71 


0.72 


0.01 


0.01 


0.04 


0.03 


0.05 


0.05 


N-2 items W/O Centering 


0.25 


0.25 


0.49 


0.50 


0.70 


0.71 


0.04 


0.02 


0.05 


0.03 


0.05 


0.06 


Average W/O Centering 


0.19 


0.14 


0.45 


0.46 


0.69 


0.71 


0.01 


0.01 


0.05 


0.03 


0.05 


0.06 


All N items W Centering 


0.18 


0.13 


0.43 


0.43 


0.76 


0.69 


0.01 


0.01 


0.05 


0.03 


0.05 


0.06 


N-2 items W Centering 


0.19 


0.15 


0.48 


0.49 


0.71 


0.72 


0.01 


0.01 


0.05 


0.03 


0.05 


0.06 


Average W Centering 


0.18 


0.13 


0.45 


0.46 


0.69 


0.71 


0.01 


0.01 


0.05 


0.03 


0.05 


0.06 


Angle 


between Clusters = 


70 (ot=80”, 3=10”) 






All N items W/O Centering 


0.26 


0.21 


0.36 


0.34 


0.45 


0.45 


0.01 


0.01 


0.03 


0.03 


0.04 


0.04 


N-2 items W/O Centering 


0.24 


0.24 


0.32 


0.31 


0.40 


0.41 


0.03 


0.02 


0.03 


0.03 


0.04 


0.05 


Average W/O Centering 


0.18 


0.13 


0.30 


0.29 


0.41 


0.41 


0.01 


0.01 


0.03 


0.03 


0.04 


0.04 


All N items W Centering 


0.18 


0.13 


0.28 


0.27 


0.39 


0.40 


0.01 


0.01 


0.03 


0.03 


0.04 


0.04 


N-2 items W Centering 


0.19 


0.15 


0.32 


0.31 


0.42 


0.43 


0.01 


0.01 


0.03 


0.03 


0.04 


0.04 


Average W Centering 


0.18 


0.13 


0.30 


0.29 


0.41 


0.41 


0.01 


0.01 


0.03 


0.03 


0.04 


0.04 


Angle 


between Clusters = 


50 (ot=70”, 3=20”) 






All N items W/O Centering 


0.26 


0.21 


0.28 


0.25 


0.32 


0.29 


0.01 


0.01 


0.02 


0.02 


0.02 


0.02 


N-2 items W/O Centering 


0.23 


0.24 


0.24 


0.24 


0.25 


0.24 


0.03 


0.02 


0.03 


0.02 


0.02 


0.01 


Average W/O Centering 


0.18 


0.13 


0.21 


0.19 


0.24 


0.23 


0.01 


0.01 


0.02 


0.02 


0.03 


0.02 


All N items W Centering 


0.17 


0.13 


0.20 


0.17 


0.24 


0.22 


0.01 


0.01 


0.02 


0.02 


0.02 


0.02 


N-2 items W Centering 


0.19 


0.15 


0.22 


0.20 


0.26 


0.24 


0.01 


0.01 


0.02 


0.02 


0.03 


0.03 


Average W Centering 


0.18 


0.13 


0.21 


0.18 


0.24 


0.22 


0.01 


0.01 


0.02 


0.02 


0.02 


0.02 



(To be continued) 
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Table 6 (Continued): D-max Value for 60 Items (Standard Deviations Are Presented 
in Smaller Font) 



Type of Conditional Score Number of Items in Each Cluster 

60-0 40-20 30-30 





N=500 


N=1000 


N=500 


N=1000 


N=500 


N=W00 


Angle between Clusters = 


30 (ot=90°, 3=0°) 






All N items W/0 Centering 


0.25 

0.01 


0.21 

0.01 


0.25 

0.01 


0.21 

0.01 


0.26 

0.01 


0.22 

0.01 


N-2 items W/0 Centering 


0.23 

0.03 


0.24 

0.02 


0.24 

0.02 


0.23 

0.02 


0.23 

0.03 


0.23 

0.02 


Average W/0 Centering 


0.18 

0.01 


0.14 

0.01 


0.18 

0.02 


0.14 

0.01 


0.18 

0.01 


0.14 

0.01 


All N items W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


0.18 

0.01 


0.14 

0.01 


N-2 items W Centering 


0.19 

0.02 


0.16 

0.01 


0.19 

0.02 


0.16 

0.01 


0.19 

0.01 


0.15 

0.01 


Average W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.02 


0.14 

0.01 


0.18 

0.01 


0.14 

0.01 


Angle between Clusters = 


10 (0^50°, 3=40°) 






All N items W/0 Centering 


0.25 

0.01 


0.21 

0.01 


0.25 

0.01 


0.21 

0.01 


0.25 

0.01 


0.21 

0.01 


N-2 items W/0 Centering 


0.23 

0.03 


0.23 

0.02 


0.23 

0.03 


0.23 

0.02 


0.23 

0.03 


0.23 

0.02 


Average W/0 Centering 


0.17 

0.01 


0.14 

0.01 


0.17 

0.01 


0.14 

0.01 


0.18 

0.01 


0.14 

0.01 


All N items W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


N-2 items W Centering 


0.19 

0.01 


0.16 

0.01 


0.19 

0.01 


0.16 

0.01 


0.19 

0.01 


0.16 

0.01 


Average W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


Angle between Clusters = 


0 (ot=45°, 


3=45°) 






All N items W/0 Centering 


0.25 

0.01 


0.21 

0.01 


0.25 

0.01 


0.21 

0.01 


0.25 

0.01 


0.21 

0.01 


N-2 items W/0 Centering 


0.23 

0.03 


0.23 

0.02 


0.23 

0.02 


0.23 

0.02 


0.23 

0.03 


0.23 

0.02 


Average W/0 Centering 


0.17 

0.01 


0.14 

0.01 


0.17 

0.01 


0.14 

0.01 


0.18 

0.01 


0.14 

0.01 


All N items W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


N-2 items W Centering 


0.19 

0.01 


0.16 

0.01 


0.19 

0.01 


0.16 

0.01 


0.19 

0.01 


0.16 

0.01 


Average W Centering 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 


0.17 

0.01 


0.13 

0.01 




Table 7: r Value for 30 Items (Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








30-0 


20- 


•10 




15-15 




N=500 N=W00 


N=500 


N=I000 


N=500 N=W00 


Angle 


between Clusters = 


90 (0^90", 


^=0^) 






All N items W/0 Centering 


0.59 


0.58 


0.80 


0.84 


0.84 


0.89 


0.02 


0.02 


0.04 


0.03 


0.04 


0.03 


N-2 items W/0 Centering 


0.61 


0.74 


0.77 


0.84 


0.79 


0.88 


0.05 


0.02 


0.06 


0.05 


0.06 


0.04 


Average W/0 Centering 


0.43 


0.46 


0.79 


0.86 


0.84 


0.92 


0.04 


0.04 


0.05 


0.04 


0.05 


0.03 


All N items W Centering 


0.40 


0.42 


0.76 


0.83 


0.82 


0.90 


0.03 


0.04 


0.06 


0.05 


0.05 


0.03 


N-2 items W Centering 


0.43 


0.49 


0.79 


0.87 


0.84 


0.92 


0.04 


0.04 


0.05 


0.03 


0.05 


0.03 


Average W Centering 


0.41 


0.45 


0.78 


0.86 


0.83 


0.92 


0.04 


0.04 


0.05 


0.04 


0.05 


0.03 


Angle 


between Clusters = 


70 (0^80°, 


P=10^^) 






All N items W/0 Centering 


0.59 


0.58 


0.71 


0.76 


0.74 


0.80 


0.03 


0.02 


0.04 


0.03 


0.04 


0.03 


N-2 items W/0 Centering 


0.60 


0.74 


0.60 


0.68 


0.61 


0.69 


0.03 


0.02 


0.05 


0.03 


0.05 


0.05 


Average W/0 Centering 


0.44 


0.48 


0.65 


0.75 


0.69 


0.80 


0.04 


0.04 


0.06 


0.04 


0.05 


0.04 


All N items W Centering 


0.41 


0.43 


0.62 


0.70 


0.66 


0.75 


0.03 


0.04 


0.06 


0.05 


0.06 


0.05 


N-2 items W Centering 


0.46 


0.53 


0.64 


0.74 


0.69 


0.79 


0.04 


0.04 


0.07 


0.05 


0.06 


0.05 


Average W Centering 


0.43 


0.47 


0.64 


0.74 


0.68 


0.79 


0.04 


0.04 


0.06 


0.05 


0.06 


0.05 


Angle 


between Clusters = 


50 (O(^70" 


3=20^^) 






All N items W/0 Centering 


0.59 


0.59 


0.63 


0.66 


0.64 


0.68 


0.02 


0.02 


0.03 


0.04 


0.03 


0.03 


N-2 items W/0 Centering 


0.61 


0.74 


0.59 


0.70 


0.58 


0.70 


0.03 


0.02 


0.04 


0.03 


0.04 


0.03 


Average W/0 Centering 


0.45 


0.50 


0.50 


0.59 


0.53 


0.61 


0.04 


0.05 


0.05 


0.06 


0.05 


0.05 


All N items W Centering 


0.42 


0.44 


0.47 


0.55 


0.49 


0.55 


0.03 


0.04 


0.05 


0.06 


0.05 


0.05 


N-2 items W Centering 


0.48 


0.55 


0.48 


0.56 


0.51 


0.58 


0.04 


0.04 


0.05 


0.06 


0.05 


0.05 


Average W Centering 


0.43 


0.49 


0.48 


0.57 


0.51 


0.59 


0.04 


0.04 


0.05 


0.06 


0.05 


0.05 



(To be continued) 
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Table 7 (Continued): r Value for 30 Items (Standard Deviations Are Presented in 
Smaller Font) 



Type of Conditional Score Number of Items in Each Cluster 

30-0 20-10 15-15 





N=500 


N=1000 


' N=500 


N=I000 


N=500 


N=1000 


Angle between Clusters = 


30 (0^90° p=0") 






All N items W/0 Centering 


0.59 

0.03 


0.59 

0.03 


0.59 

0.03 


0.59 

0.03 


0.59 

0.02 


0.59 

0.03 


N-2 items W/0 Centering 


0.61 

0.04 


0.73 

0.03 


0.61 

0.03 


0.73 

0.02 


0.60 

0.03 


0.73 

0.03 


Average W/0 Centering 


0.46 

0.04 


0.51 

0.05 


0.45 

0.03 


0.49 

0.05 


0.45 

0.04 


0.50 

0.05 


All N items W Centering 


0.42 

0.04 


0.45 

0.04 


0.41 

0.03 


0.44 

0.04 


0.42 

0.03 


0.44 

0.04 


N-2 items W Centering 


0.49 

0.04 


0.55 

0.04 


0.47 

0.05 


0.55 

0.05 


0.48 

0.04 


0.55 

0.04 


Average W Centering 


0.44 

0.04 


0.50 

0.05 


0.43 

0.04 


0.49 

0.05 


0.44 

0.04 


0.49 

0.05 


Angle between Clusters = 


10 (0=50° B=40") 






All N items W/0 Centering 


0.59 

0.02 


0.59 

0.03 


0.59 

0.02 


0.59 

0.03 


0.59 

0.03 


0.59 

0.02 


N-2 items W/0 Centering 


0.61 

0.04 


0.73 

0.03 


0.61 

0.03 


0.73 

0.03 


0.61 

0.03 


0.73 

0.03 


Average W/0 Centering 


0.45 

0.04 


0.52 

0.05 


0.46 

0.04 


0.52 

0.05 


0.46 

0.05 


0.51 

0.05 


All N items W Centering 


0.42 

0.04 


0.46 

0.04 


0.42 

0.04 


0.46 

0.04 


0.42 

0.04 


0.46 

0.04 


N-2 items W Centering 


0.49 

0.04 


0.56 

0.05 


0.49 

0.05 


0.57 

0.04 


0.49 

0.05 


0.56 

0.04 


Average W Centering 


0.45 

0.04 


0.51 

0.05 


0.45 

0.04 


0.51 

0.05 


0.44 

0.05 


0.50 

0.05 


Angle between Clusters = 


0 (0=45" B=45") 






All N items W/0 Centering 


0.59 

0.03 


0.59 

0.03 


0.59 

0.03 


0.59 

0.02 


0.59 

0.02 


0.59 

0.03 


N-2 items W/0 Centering 


0.61 

0.03 


0.73 

0.03 


0.61 

0.03 


0.73 

0.03 


0.61 

0.04 


0.73 

0.03 


Average W/0 Centering 


0.46 

0.04 


0.52 

0.05 


0.46 

0.04 


0.51 

0.04 


0.46 

0.04 


0.52 

0.05 


All N items W Centering 


0.43 

0.04 


0.46 

0.04 


0.42 

0.04 


0.45 

0.04 


0.42 

0.03 


0.46 

0.04 


N-2 items W Centering 


0.49 

0.05 


0.56 

0.05 


0.49 

0.05 


0.56 

0.04 


0.48 

0.04 


0.56 

0.04 


Average W Centering 


0.45 

0.05 


0.51 

0.05 


0.45 

0.04 


0.50 

0.05 


0.44 

0.04 


0.51 

0.05 





Table 8: r Value for 60 Items (Standard Deviations Are Presented in Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 






60-0 


40 


-20 


30 


-30 




N=500 


N=J000 


N=500 


N=1000 


N=500 


N=1000 


Angle 


between Clusters = 90 (ot=90^, 


,M°) 






All N items W/0 Centering 


0.43 


0.46 


0.64 


0.74 


0.77 


0.86 


0.01 


0.01 


0.03 


0.02 


0.03 


0.02 


N-2 items W/0 Centering 


0.38 


0.50 


0.62 


0.75 


0.75 


0.86 




0.05 


0.04 


0.05 


0.03 


0.03 


0.03 


Average W/0 Centering 


0.31 


0.31 


0.61 


0.73 


0.77 


0.87 


0.02 


0.02 


0.05 


0.03 


0.03 


0.02 


All N items W Centering 


0.30 


0.30 


0.58 


0.70 


0.76 


0.87 


0.02 


0.02 


0.05 


0.03 


0.03 


0.03 


N-2 items W Centering 


0.31 


0.32 


0.62 


0.75 


0.77 


0.87 


0.02 


0.02 


0.05 


0.03 


0.03 


0.02 


Average W Centering 


0.31 


0.31 


0.61 


0.73 


0.77 


0.87 


0.02 


0.02 


0.05 


0.03 


0.03 


0.02 


Angle 


between Clusters = 70 (a^80^, 


p=io") 






All N items W/0 Centering 


0.44 


0.46 


0.54 


0.64 


0.63 


0.73 


0.02 


0.01 


0.03 


0.03 


0.03 


0.03 


N-2 items W/0 Centering 


0.38 


0.50 


0.46 


0.57 


0.55 


0.61 


0.04 


0.03 


0.04 


0.04 


0.04 


0.05 


Average W/0 Centering 


0.31 


0.32 


0.47 


0.58 


0.59 


0.71 




0.02 


0.02 


0.03 


0.04 


0.04 


0.04 


All N items W Centering 


0.30 


0.31 


0.45 


0.55 


0.57 


0.69 


0.02 


0.02 


0.04 


0.04 


0.04 


0.04 


N-2 items W Centering 


0.32 


0.33 


0.49 


0.60 


0.59 


0.71 


0.02 


0.02 


0.03 


0.03 


0.04 


0.04 


Average W Centering 


0.31 


0.31 


0.47 


0.58 


0.58 


0.71 




0.02 


0.02 


0.03 


0.04 


0.04 


0.04 


Angle 


between Clusters = 50 (0(^70”, 


3=20") 






All N items W/0 Centering 


0.43 


0.46 


0.46 


0.53 


0.50 


0.59 


0.02 


0.01 


0.02 


0.02 


0.03 


0.03 


N-2 items W/0 Centering 


0.38 


0.51 


0.38 


0.48 


0.38 


0.48 


0.04 


0.03 


0.04 


0.03 


0.03 


0.02 


Average W/0 Centering 


0.32 


0.33 


0.36 


0.43 


0.41 


0.50 




0.02 


0.02 


0.03 


0.03 


0.04 


0.04 


All N items W Centering 


0.31 


0.32 


0.34 


0.40 


0.39 


0.47 


0.02 


0.02 


0.03 


0.03 


0.03 


0.04 


N-2 items W Centering 


0.32 


0.35 


0.37 


0.44 


0.41 


0.49 


0.02 


0.02 


0.03 


0.03 


0.04 


0.04 


Average W Centering 


0.31 


0.32 


0.36 


0.42 


0.40 


0.49 




0.02 


0.02 


0.03 


0.03 


0.03 


0.04 



(To be continued) 
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Table 8 (Continued): r Value for 60 Items (Standard Deviations Are Presented in 
Smaller Font) 



Type of Conditional Score 




Number of Items in Each Cluster 








60-0 


40-20 




30-30 




N=500 N=1000 


N=500 


N=1000 


N=500 N=1000 


Angle between Clusters = 


30 (0(^90" 


3=0") 






All N items W/0 Centering 


0.44 


0.46 


0.44 


0.47 


.0.44 


0.48 




0.02 


0.02 


0.02 


0.02 


0.02 


0.02 


N-2 items W/0 Centering 


0.39 


0.51 


0.39 


0.50 


0.38 


0.50 




0.04 


0.03 


0.04 


0.03 


0.04 


0.03 


Average W/0 Centering 


0.32 


0.33 


0.32 


0.35 


0.32 


0.34 




0.02 


0.02 


0.02 


0.03 


0.02 


0.03 


All N items W Centering 


0.31 


0.32 
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Figure 1 : Description of Item Angle 




Figure 2: Example of a Test with Two Item Clusters 




Figure 3: Percentage of Items Correctly Classified into Clusters — 30 items 

Figure 3a: 
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Figure 3b: 



Cluster=20/10 N=1000 




90 70 50 30 10 



♦ All N items W/0 Centering 
-« " ■ N-2 items W/0 Centering 
Average W/0 Centering 
—X— All N items W Centering 
- X"" N-2 items W Centering 
Average W Centering 



Angle Between Clusters 




34 



Figure 3c: 




Figure 3d: 
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Figure 4. Percentage of Items Correctly Classified into Clusters - 60 items 

Figure 4a: 
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Figure 4c: 
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Figure 4d: 
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Figure 5: D-max Values for 30 Items 
Figure 5a: 
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Figure 5b: 
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Figure 5c: 




Figure 5d: 
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Figure 5e: 
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Figure 5f: 
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Figure 6: D-max Values for 60 Items 
Figure 6a: 
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Figure 6b: 
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Figure 6c: 
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Figure 6d: 
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Figure 6e: 
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Figure 6f; 
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Figure 7: R Ratio for 30 Items 
Figure 7a: 
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Figure 7b; 
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Figure 7c: 




Figure 7d: 
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Figure 8: R Ratio for 60 Items 



Figure 8a: 



Cluster=40/20 N=500 




90 70 50 30 10 



—4 — All N items W/0 Centering 
N-2 items W/0 Centering 
Average W/0 Centering 
— All N items W Centering 
X N‘2 items W Centering 
# Average W Centering 



Angle Between Clusters 



Figure 8b: 
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Figure 8c: 
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Figure 8d: 
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Figure 9: Average percentage of correct classification 



Figure 9a: 
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Figure 10: Average Dmax values 
Figure 10a: 
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Figure 10b: 
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Figure 10c: 
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Figure lOd: 
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Figure 1 1 : Average r ratio 
Figure I la: 
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Figure 11b: 
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